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(g) Image processing device and method. 

(g) The present invention provides the image 
reproducing device which decides an error con- 
cealing characteristic in accordance with sub- 
ordinate data transmitted with the image data, 
the subordinate data indicating an encoding 
characteristic of encoded image data, to prop- 
erly conceal the image involving code errors 
without a large amount of circuit elements. The 
present invention also provides the image pro- 
cessing device which detects the motion of the 
image by using AC component information to 
accurately detect the motion of the image sig- 
nal. 
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pect may be used alone or in combination with any other aspect 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a biock diagram showing a primary part of an image signal recording apparatus which is con- 
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shows a zero frequency (DC) coefficient and high frequency coefficients. . _ . 

Figure 5 shows how to zig-zag scan the orthogonal transformed block shown in Figure * 

Figure 6 shows a structure of a transmitting signal output from the apparatus shown in Figure 1. 

Figure 7 is a block diagram showing a primary part of an image signal reproducing . »PP^""^ ,n 9 
to the first embodiment of the present invention, for reproducing an image signal from the transmitted signal 
transmitted bv the apparatus shown in Figure 1 . , . 

F 7gure 8 a blocHagram which shows actual circuits of a concealing circuit and a motion detecting cir- 
cuit, both of which are shown in Figure 7. , af ,„n 

Figure 9 is a model of a part of the image signal used for explaining one method of '"^'atlon- 

Figure 10 is a model of a part of the image signal used for explaining another method of mterpola ion. 

Figure 11 is a model of a part of the image signal used for explaining further method of interpotetion 

Figure 12 is a block diagram showing a primary part of another image signal recording apparatus which 
is concerned with a second embodiment of the present invention. 

Fiaure 1 3 is a block diagram which shows actual circuits of a DCT circuit shown in Figure 12. 

Figure 14 shows a model of pixels in one block which are distinguished between odd and even fields. 

Figure 15 is a block diagram snowing a primary part of another image signal reproduang apparatus ac- 
cording to the second embodiment of the present invention for reproducing an image signal from the trans- 
mitted signal transmitted by the apparatus shown in Figure 1-2. ^ 

Rgure 16 is a block diagram which shows actual circuits of ah l-DCT circuit 9 and a concealing crcurt, 

both of which are shown in Figure 15. 

Figure 17 is a model of pixels in two adjacent blocks used for explaining one method of an intra-frame 

interpolation. 

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 

Embodiments of the present invention will now be described, by way of example only, with reference to 

the accompanying drawings. . ... _ ... 

Figure 1 is a block diagram of an image signal recording apparatus wh.ch is concerned with a first em- 
bodiment of the present invention. In Figure 1. an original analogue image signal is input to an input termmal 

2 " The analogue image signal is digitized by an analogue-to-digital (A/D) converter 4. and the ^ed^e 
signal is divided into blocks each of which is composed of (MxN) pixels having M pixels in a horizontal direction 
and N pixels in a vertical direction by a (MxN) blocking circuit 6. 

Figure 2 shows a model of dividing a frame into blocks, shows as D1 .D2.D3 When it is assumed that 

each of M and N is 8. one block is composed of 64 pixels as shown in Figure 3. 

The image signal divided into blocks by the circuit 6 is orthogonal-transformed by Discrete Cosine Trans- 
forming (DCT) circuit 8. Figure 4 shows DCT coefficients which compose a block orthogonal y transformed 
according to the DCT by the DCT circuit 8. These coefficients are distinguished between a "dfred : current" 
(zero spatial frequency) coefficient hatched in Figure 4. hereinafter called a DC component, and alternating 
current" (non-zero spatial frequency) coefficients, hereinafter called AC components. 

The AC components output from the DCT circuit 8 are supplied to a zig-zag scanning circuit 10 and are 
scanned from a low frequency to a high frequency in a two-dimensional 'requencyregion ae shown , .n ^gure 
5. The AC components are supplied to a quantizing circuit 12 and a criticality detecting circuit 22 in the order 
scanned in the zig-zag scanning circuit 10. 

The quantizing circuit 12 quantizes the AC components by using an appropriate table selected from among 
a plurality of quantizing tables. The appropriate table is selected so that an amount of data output from the 
quantizing circuit 1 2 becomes uniform in a certain unit of the image signal, for example one frame . one field, 
several lines, or a predetermined number of the blocks. . 

The quantized data are supplied to a buffer 14 and a quantized level detecting crcurt 16. The quantized 
level detecting circuit 16 detects a table number used in the quantizing circuit 12 and outputs* as a quantizing 
factor Q. Accordingly, the image data is formed into units of a uniform size, adapted to P-^et^mined date 
format, for recording onamagnetic tape, reproducing from the tape at any «P^" 

Figure 6 shows a structure of a transmitting signal according to a predetermmed format in whjch the 
amount of data is made uniform in every six DCT blocks and one synchronizing bk^comprises data of sb< 
DCT blocks. Figure 6 is a diagrammatic representation of the basic signal format In this figure the height of 
the longitudinal row represents 8 bits. i.e. one byte. The top left hand corner of the row represents the firs 
synchronising bit Thus successive bytes are effectively arranged side-by-side transverse to the longttudinal 
aiisof the row When the data is transmitted it is transmitted serially starting with the first synchronising bit 
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In Figure 6. CR indicates a criticality of each block. The critlcality is detected in the criticality detecting 
circuit 22 by a method, for example, as follows. ^ _ ^ . 

In each unit, which is composed of six DCT blocks in this embodiment, there might be a block having a lot 
of high frequency coefficients and a block having few high frequency coefficients. If all of blocks in each unit 
s are quantized by a common characteristic, it will appear that an image feature in the block having many high 
frequency coefficients and an image feature in the block having few high frequency coefficients have different 
levels of definition. The criticalities are used for compensating such difference by adjusting the quantizing 
characteristic in an adaptive rounding circuit 18. _«..». 
Firstly the criticality detecting circuit 22 compares each of the values of high frequency coefficients in 
10 each DCT block (shown in Figure 4 as H) with a predetermined value. Secondly, the circuit 22 count* a number 
of high frequency coefficients having a value exceeding the predetermined value in each DCT block, and clas- 
sifies each DCT block into several. e.g. four, classes on the basis of the counted number. These classes rep- 
resent characteristics of images in each of DCT blocks. The criticality detecting circuit 22 outputs the cnticality 
composed of several. e.g. two. bits which indicates one of the classes. The criticality is shown as CR in Figure 
15 1 and is essential to adjust the quantizing characteristic. 

The adaptive rounding circuit 18 receives quantized coefficient data via the buffer 14 and adaptively 
rounds off less significant bits thereof according to the criticality CR and the quantizing factor Q for each DCT 
block. The output data of the adaptive rounding circuit 18 are supplied to a variable length encoding circuit 20 
and are encoded by a given encoding method which combines a number of continuous 0 coefficients and coef- 
20 f icients being 1 or more and gives codes to such combinations. Accordingly, the variable encoding circuit 20 
outputs remarkably compressed codes representing AC components. 

The compressed codes of the AC components, shown in Figure 1 as CODE, the DC component, the quan- 
tizing factors Q, and the criticalities CR are input to a recording circuit 24. The recording circuit 24 forms the 
synchronizing block as shown in Figure 6. In Figure 6. Sync indicates synchronizing codes which are used for 
picking up all codes in a reproducing system. ID indicates identification codes Including a frame number and 
so on CRC indicates Cyclic Redundancy Check code as error check codes for the identification codes ID, 
and Parity Indicates parity codes composing an error correction code. The recording circuit 24 forms these 
codes and forms the synchronizing blocks each of which is composed of the synchronizing codes (Sync), iden- 
tification codes (ID), error check codes (CRC). the quantizing factor (Q). six groups of main codes, each of 
which is composed of one DC component (DC), the criticality (CR). and compressed codes (AC), and the panty 
codes (Parity). Each of DC components (DC) and the criticalities (CR) in respective group corresponds to re- 
spective DCT block. But the boundary of compressed codes (AC) between adjacent DCT block varies accord- 
ing to the characteristic of the image. 

The recording circuit 24 constantly outputs such synchronizing block as the transmitting signal. The trans- 
35 mitting signal is supplied to a transmitting path. e.g. a magnetic tape, to be recorded on it, via an output terminal 
2b 

Figure 7 shows a reproducing (receiving) apparatus which reproduces the image signal from the trans- 
mitting signal transmitted by the apparatus shown in Figure 1 , as the first embodiment of the present invention. 
In Figure 7 an input terminal 21 inputs the transmitting signal transmitted via the transmitting path, e.g. 
40 the magnetic tape, and supplies it to the reproducing circuits 19. The reproducing circuit 19 reproduces code 
sequence on the basis of the synchronizing codes, and separates the DC components (DC), the compressed 
AC components (AC), the quantizing factors (Q), and the criticalities (CR) from the code sequence, and cor- 
rects correctable code errors by using the parity codes. 

The compressed AC components (AC) are decoded by a variable length decoding circuit 17 and the AC 
45 components are reproduced therein. The AC components output from the decoding circuit 17 are supplied to 
a reverse rounding circuit 15 and are adaptively rounded out by adding less significant bits according to the 
quantizing factor (Q) and the criticalities (CR) separated by the reproducing circuit 19. The process of rounding 
out (reverse-rounding) is adaptively carried out for each DCT block. 

A reverse-quantizing circuit 13 reverse-quantizes the AC components according to the quantizing factors 
so (Q). The AC components output from the reverse-quantizing circuit 13 are supplied to a reverse zig-zag scan- 
ning circuit 11 and are output therefrom in the original order. An inverse Discrete Cosine Transforming (l-DCT) 
circuit 9 orthogonally transforms the AC components output from the reverse zig-zag scanning circuit 11 and 
the DC component separated by the reproducing circuit 9 from a frequency domain to an amplitude domain. 
Further, error flags indicating that uncorrectable errors have occurred in each DCT block are supplied from 
55 the reproducing circuit 19 to the l-DCT circuit 9 with the DC components. 

The l-DCT circuit 9 outputs the image signal with the error flags in units of blocks and supplies it to a con- 
cealing circuit 7. The concealing circuit 7 operates according to a result of detecting motions detected by a 
motion detecting circuit 23. The operations in the concealing circuit 7 and the motion detecting circuit 23 will 
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be described in detail hereinafter. . . . t 

The image signal outputfrom the concealing circuit 7 is supplied to a raster scanning circuit 5 and outputs 
therefrom in the order which corresponds to a raster scanning. The image signal outputfrom theraster scan- 
ning circuit 5 is converted to an analogue image signal by a digital-to-analogue (D/A) converter 3. The analogue 
image signal output from the D/A converter 3 is externally output via an output terminal 1. 

The detailed operations in the concealing circuit7 and the motion detecting circuit 23 are described below. 
Figure 8 is a block diagram of the concealing circuit 7 and motion detecting circuit 23. The image signal to be 
concealed is inputvia an Input terminal 30 with the error flags. The critlcalitiesCRare input via an .nput terminal 
29 The motion detecting circuit 23 detects whether or not a motion is involved in the image between the pres- 
ent frame and the previous frame and between the present frame and the following frame. The concealing 
circuit 7 adaptively conceals a block having an uncorrectable code error on the basis of the result of such de- 

The image signal and error flags input to the terminal 30 are delayed for one frame period by a frame 
memory 31 . The delayed image signal 31 output from the frame memory 31 are delayed for another one frame 

is period by a frame memory 33. After this, the delayed image signal is treated as an image signal in the present 
frame The error flags which are attached at heads of respective blocks are detected by an error judging circuit 
37. The error judging circuit 37 outputs a control signal which indicates whether or not the block output from 
the frame memory 31 includes uncorrectable errors on the basis of the error flags. 

Switches 35,36 are controlled by the control signal produced by the error judging circuit 37. Therefore, a 

20 block including no errors output from the frame memory 31 is Jjrectly output from an output terming 38 tav the 
raster scanning circuit 5 shown in Figure 7 via a terminal V of the switch 35 and a terminal c of the switch 
36 

' When a block including uncorrectable errors is output from the frame memory 34, the control signal lets 
the switch 35 connect to a terminal "b" and lets the switch 36 connect to a terminal M\ In short, the image 

25 signal of the present frame output from the frame memory 31 is supplied to a concealment selection circuit 
39. and an output signal, as an interpolating signal, output from the concealment selection 39 is output from 
the terminal 38 instead of the block having uncorrectable errors. 

Amotion discriminating circuit 40 picks up DC components of the presentframe DC1 from the image signa 
output from the frame memory 31. picks up DC components of the following frame DC2 from the image signa 

so input to the input terminal 30 and picks up DC components of the previous frame DC3 from the image signal 
outputfrom the frame memory 33. These DC components are most important components of the orthogonally 
transformed block and. what is more, there is a relatively high possibility that they reproduced correctly be- 
cause they are encoded by a fixed length encoding, compared to the AC components encoded by a variable 
length encoding. Therefore the DC components DC1.DC2.DC3 are supplied to the motion discriminating cir- 

35 ° Uit The criticalities input to the input terminal 29 are supplied to the motion discriminating circuit 40 as criti- 
calities of the following frame CR2. and are delayed for one frame period of time by a frame menwry 42 The 
criticalities outputfrom the frame memory 42 are supplied to the motion discriminating circuit 40 as ^«* h ^ 
of the present frame CR1 , and are delayed for another frame period of time by a frame memory 43JHe i crit- 
icalities output from the frame memory 43 are supplied to the motion discriminating circuit 40 as cnticalit.es 
of the previous frame. These memories 42.43 need to have a much smaller capacity than that of the frame 
memories 31 and 33, because the criticalities have a little data. e.g. only two bits for each DCT block. 

The operations in the motion discriminating circuit 40 will be described below with reference to Figure 9 
and Table 1. 
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produces a judging result The judging result is produced on the basis of whether or not the absolute value of 
the difference between DC1 and DC2 exceeds a predetermined threshold value. When the absolute value ex- 
ceeds the threshold value, the judging result indicates an existence of a motion that is shown as "0 on the 
line of DC at the column of following frame of result of comparisons in the Table 1. Similarly, the existence of 
a motion is judged by comparing the DC1 with DC3. and is shown on the line of DC at the columnof previous 
frame of results of comparisons. Further the existence of a motion is also judged by comparing the CR1 with 
the CR2 and by the CR1 with the CR3. These results are shown on the line of CR at the columns of results of 

^Sgirfg pattern 1 shown in the Table 1 indicates that all of the comparison results indicate the existence 
of the motion. In this pattern, final judgements for previous and following frames naturally indicate the exis- 
tence of the motion tr. and the interpolation must be the intra-f rame interpolation. For example, in the subject 
(present) frame in Figure 9. the subject block to be concealed which is hatched is interpolated by using adjacent 
blocks. e.g. blocks O.P.Q.R.S.T.U and V. _ . 

Ajudging pattern 2 includes two cases. One indicates that both results concerned with the previous and 
following frames indicate the existence of the motion on the basis of the DC components, and a result con- 
cerned with the previous frame indicates no motion but a result concerned with the following frame indicates 
the existence of motion on the basis of the criticalities CR (AC components). The other indicates that both 
results concerned with the previous and following frames indicate the existence of motion on the basis of the 
criticalities CR. and a result concerned with the previous frame indicates no motion but a result concerned 
with the following frame indicates the existence of motion on the basis of the DC components DC, In this pat- 
tern the final judgement for the following frame is naturally the existence of motion, but the final judgement 
for the previous frame is indefinite, shown as --• in the table 1 . In this embodiment, when the final judgement 
is indefinite inter-frame interpolation is not used . to be on the safe side. Therefore, the intra-frame inter- 
polation is executed also in the pattern 2. 

Ajudging pattern 3 indicates the case in which the final judgement for the previous frame is the existence 
of motion and the final judgementfor thefbllowingframe is indefinite. In this pattern 3. intra-frame interpolation 
is executed by the reason described above. . „. _ 

Judging patterns 4.6 indicate the case in which both final judgements forthe previous and following frames 
are indefinite. In these patterns, intra-frame interpolation is executed to be on the safe side. 

Judging patterns 5.7 indicate the case in which the final judgement for the previous frame is no-motion 
and the final judgement for the following frame is the existence of motion or indefinite. In these patterns, inter- 
f rame Interpolation using only the previous frame is executed. 

Judging patterns 8.9 indicate the case in which the final judgement for the following frame is no-motion 
and the final judgement for the previous frame is the existence of motion or indefinite. In these patterns, inter- 
frame interpolation using only the following frame is executed. 

Ajudging pattern 10 indicates the case in which all of the comparison results are no motion. In this case, 
inter-frame interpolations using only the previous frame, only the following frame, or the average value of the 
previous and following frame can be used. 

When the DC component or the criticality is missing because of an uncorrectable error or the like, it is 
possible to make the judgement by comparing the block A with the block Al. the block A with the block A2 the 
block B with the block B1. the block B with the block B2. the block C with the block C1. the block C with the 
block C2. the block D with the block D1. or the block D with the block D2. in short, by using adjacent blocks 
to the subject block shown in Figure 10. 

Further, when it is impossible to compare the criticalities or the DC components of the subject block be- 
tween the present frame and the previous or following frame, it is possible to interpolate the criticality or the 
DC component For example, the most similar block to the subject block is decided among blocks surrounding 
it by comparing the DC components and the criticalities of the right and left blocks (A1 and A2). those of the 
upper and lower blocks (B1 and B2). those of the diagonal blocks (C1 and C2. or D1 and D2). shown in Figure 
11. and the interpolation for the DC component or the criticality is executed by using the most similar blocks 
decided by the procedure described above. 

According to the description of Table 1 . output of the motion discriminating circuit is composed of two or 
three bits and is supplied to a concealment selection circuit 39. The concealment selection circuit 39 executes 
inter-frame or intra-frame interpolation according to the output of the motion discriminating circuit 40. 

Accordingly, the Mock in which an uncorrectable error has occurred is replaced with the appropriate in- 
terpolating block output from the concealment selection circuit 39 and the interpolating block is output to the 
raster scanning circuit via a terminal "d" of a switch 36 and a terminal 38. 

According to the first embodiment described above, there are many effects listed below. 

Firstly, the motion discrimination circuit used for selecting a switching interpolating method has small hard- 
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ware because of using only encoded DC components or the criticalities to be used for encoding which are com- 
posed of small amount of data. 

Secondly, the motion discrimination has considerably high dependability because the existence of motion 
is decided on the basis of not only the DC component but also the AC component of the image signal. 

ThWIy, the amount of any circuitry is not increased because the criticalities are originally necessary for 
the encoding circuit and are efficiently used in this embodiment 

A second embodiment of the present invention win be described below by referring to the Figures 12 to 
17. Figure 12 is a block diagram of an image signal recording apparatus which is concerned with the second 
embodiment of the present invention. In Figure 12, similar elements to the Figure 1 are numbered the same 
as the Figure 1. 

The marked differences between the Figure 1 and the Figure 12 are in the DCT circuit and the blocking 
circuit So a (4x8) blocking circuit 6a and a DCT circuit 8a are described in detail by referring to Figure 13 

In Figure 13, the digitized image signal input to an input terminal 51 from the A/D converter 4 is supplied 
to the (4x8) blocking circuit and is divided into (4x8) blocks each of which is composed of (4x8) pixels having 
8 pixels in a horizontal direction and 4 pixels in a vertical direction. These (4x8) pixels are In the same field 
The image signal divided into the (4x8) blocks is supplied to a field delay circuit 53 and a motion detecting 
circuit 54 in the DCT circuit 8a. 

The output image signal delayed for one field period is supplied to a further field delay circuit 55 an (8x8) 
DCT circuit 57 and the motion detecting circuit 54. The (4x8) block in a first field of a certain frame output 
from the field delay circuit 53 and the (4x8) block in a second field of the frame, which are concerned with a 
common (8x8) block in the frame, are simultaneously supplied to the motion detecting circuit 54. 

Figure 14 shows a model of pixels in a certain (8x8) block. In Figure 14, thirty-two pixels shown as "O" 
are in the first field and comprise 4 lines each of which has 8 pixels, and the thirty-two pixels shown as "□" 
are in the second field and comprise 4 lines each of which has 8 pixels. 

The motion detecting circuit 54 subtracts values of the 32 pixels in the first field from respective values 
of the 32 pixels located just upper side of the former 32 pixels, and sums the 32 absolute values of the sub- 
tracting results. Further, the motion detecting circuit 54 discriminates by determining that a considerable dif- 
ference is involved in the subject (8x8) block between the fields and that motion exists, when the sum of the 
32 absolute values exceeds a predetermined threshold value, and by determining that no motion exists in the 
subject (8x8) block when the sum of the 32 absolute values does not exceed the predetermined threshold value 
The one-bit result of the discrimination is used for controlling a switch 58 and is supplied to a recording circuit 
24a via a terminal 50. 

The field delay circuit 55 delays the image signal output from the field delay circuit 53 for one field period 
of time and supplies it to the (8x8) DCT circuit 57 and a (4x8) DCT circuit 60. The (8x8) DCT circuit 57 discrete- 
cosine-transforms (8x8) pixels which are interlaced as showo in Figure 14 directly, and outputs 32 coefficients 
to a terminal "S" of the switch 58. 

The (4x8) DCT circuit 60 discrete-cosine-transforms (4x8) pixels in the first field, and outputs 16 coeffi- 
cients to a multiplexing circuit 61 . The (4x8) DCT circuit 56 discrete-cosine-transforms (4x8) pixels in the sec- 
ond field, and outputs 16 coefficients to the multiplexing circuit 61. 

The multiplexing circuit 61 multiplexes 16 coefficients of the first field and 16 coefficients of the second 
field and supplies the multiplexed coefficients to a terminal "M" of the switch 58. The switch 58 outputs the 
coefficients output from the (8x8) DCT circuit 57 via the terminal "S" when the subject block is discriminated 
as a block in a still area, and outputs the coefficients output from the multiplexing circuit 61 when the subject 
block is discriminated as a block in a motion area, in accordance with the discrimination result output from the 
motion detecting circuit 54. 

The coefficients output from the switch 58 are supplied to an AC/DC separation circuit 59 which separates 
the DC component from the. AC component Only the DC component of the first field Is separated as the DC 
component, while the DC component of the second field is not separated (as for the AC components) The 
DC component is directly supplied to a recording circuit 24a via a terminal 48 and the AC components and the 
DC component of the second field are supplied to a zig-zag scanning unit 1 0a. 

The zig-zag scanning circuit 10a operates the same as the circuit 10 shown in Figure 1 when the coeffi- 
cients output from the (8x8) DCT circuit 57 are supplied. When the coefficients output from the multiplexing 
creuit 61 are supplied, the zig-zag scanning circuit 10a scans these coefficients of the two fields including 
the DC component of the second field from low frequency component to high frequency component The op- 
eration of the zig-zag scanning circuit 10a is changed as described above on the basis of the discriminating 
result of the motion detecting circuit which is output from the DCT circuit 8a as motion information Ml 

The operations of the circuits 12.14.16.18.20 and 22 are not described again because they are similar to 
the circuits in Figure 1. The recording circuit 24a outputs the transmitting signal composed of the sequence 
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of the synchronizing blocks shown in Figure 6 in which the identification codes include the motion information 
Ml. 

Figure 15 is a block diagram which shows a reproducing apparatus which reproduces the image signal 
from the transmitting signal transmitted by the apparatus shown in Figure 12, as the second embodiment of 
the present invention. In Figure 15, similar elements to the Figure 7 are numbered the same as the Figure 7. 

The transmitted signal is input to a reproducing circuit 19a via a terminal 21. The reproducing circuit 19a 
reproduces the code sequence, and separates the DC components (DC), the compressed AC components 
(AC), the quantizing factors (Q). the criticalities (CR), and the motion information (Ml). The motion information 
(Ml) is supplied to a reverse zig-zag scanning circuit lla, l-DCT circuit 9a and a concealing circuit 7a. The circuits 
1 3, 1 5 and 1 7 operate the same as Figure 7, and the reverse quantizing circuit 1 3 outputs the reverse-quantized 
coefficients. 

The reverse zig-zag scanning circuit 11a changes the order of the coefficients into the original order, and 
supplies the coefficients to the l-DCT circuit 9a. 

Figure 16 is a block diagram which shows the l-DCT circuit 9a and the concealing circuit 7a in detail. In 
Figure 16, the DC components separated by the reproducing circuit 19a are supplied to an input terminal 80, 
the AC components including the DC component of the second field are supplied to an input terminal 81, and 
the motion information (Ml) is supplied to an input terminal 82. The error flags are supplied to the terminal 80 
with the DC component An AC/DC multiplexing circuit 83 multiplexes the AC components, the DC compo- 
nents, and error flags and supplied the multiplexed signal to a switch 64. 

The motion information supplied to the input terminal 82 controls the switch 64, a switch 65, a switch 66 
and is supplied to a delay circuit 67. The switch 64 connects the circuit 83 to a terminal "S° when the motion 
information indicates that the subject block is in the still area, and connects it to a terminal "M" when the motion 
information indicates that the subject block is in the motion area. The terminal "S" of the switch 64 is connected 
with an (8x8) l-DCT circuit 68, and the terminal W M" of the switch 64 is connected with a separating circuit 69. 

When the subject block is in the still area, the coefficients input to the switch 64 are supplied to the (8x8) 
IDCT circuit 68 and are reverse-discrete-cosine transformed from the frequency domain to the amplitude do- 
main. The image data of the first field transformed by the IDCT circuit 68 are supplied to a terminal "S" of a 
switch 66, and the image data of the second field transformed by the IDCT circuit 68 are supplied to a terminal 
"S" of a switch 65. 

When the subject block is in a motion area, the coefficients input to the switch 64 are supplied to the sep- 
arating circuit 69 and are separated into groups of the first and second fields. The coefficients of the first field 
separated by the separating circuit 69 are supplied to a (4x8) IDCT circuit 70, and the coefficients of the second 
field separated by the separating circuit 69 are supplied to a (4x8) IDCT circuit 71 . Each of the (4x8) IDCT cir- 
cuits reverse-discrete-cosine-transfbrms the coefficients from the frequency domain to the amplitude domain. 

The image data of the first field output from the (4x8) IDCT circuit 70 are supplied to a terminal "M" of the 
switch 66, and the image data of the second field output from the (4x8) IDCT circuit 71 are supplied to a terminal 
"M" of the switch 65. The switch 66 is switched by the motion information and supplies the image data output 
from the (8x8) IDCT circuit 68 or the (4x8) IDCT circuit as the image data of the first field to a terminal "A" of 
a switch 72. The switch 65 is switched by the motion information and supplies the image data output from the 
(8x8) IDCT circuit 68 or the (4x8) IDCT circuit as the image data to a field delay circuit 73. 

The field delay circuit 73 delays the image data of the second field for one field period of time and supplies 
them to a terminal "B" of a switch 72. The switch 72 is switched every one field period and alternately outputs 
the image data of the first field via the terminal "A" and the image data of the second field via the terminal 
"B". The image signal output from the switch 72 is supplied to a terminal "N" of a switch 74. 

An error judging circuit 84 judges whether or not the subject block involves uncorrectable code errors on 
the basis of the error flags transmitted with the DC components, and outputs a control signal to the switch 
74. The switch 74 outputs the image signal output from the switch 72 via the terminal "N" when the subject 
block does not involve an uncorrectable code error, and outputs the image signal output from a switch 78 via 
the terminal "F when the subject block involves an uncorrectable code error. 

The image signal output from the switch 74 is supplied to a frame delay circuit 76, a block delay circuit 
77, and the raster scanning circuit 5 shown in Figure 15. The image signal output from the frame delay circuit 
76 is supplied to a terminal "S* of the switch 78 and the image signal output from the block delay circuit 77 is 
supplied to a terminal "M" of the switch 78. 

The delay circuit 67 outputs the motion information to judge whether the subject block is in the motion 
area or not Various ideas may be applied to design the delay circuit 67. some of these ideas being listed below. 

A first Idea is that the delay circuit 67 outputs the motion information of the adjacent block to the subject 
block, because there is a high possibility that the motion information involves uncorrectable errors when the 
image data of the subject block involves uncorrectable errors and the motion information is transmitted in the 
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same synchronizing block. 

A second idea is that the delay circuit 67 outputs the motion information of the subject block by compen- 
sating the processing time, when the motion information can be corrected, even if the image information in- 
volves uncorrectable errors, by adding sufficient redundant codes to the motion information. 

A third idea is that the delay circuit 67 outputs the motion information of the subject block which is located 
in a different synchronizing block from the synchronizing block in which the image data of the subject block 
is located. 

It is effective that the second or third idea is used because the motion information is correctably detected 
in the recording apparatus. 

The switch 78 selects the image signal output from the frame delay circuit 76 when the subject block is 
judged to involve no motion, and selects the image signal output from the block delay circuit 77 when the sub- 
ject block is judged to involve motion. In short, the switch 78 selects the inter-frame interpolation or the intra- 
frame interpolation. 

The frame delay circuit 76 delays the image signal for one frame period of time to replace all of the (8x8) 
pixels of the subject block with the (8x8) pixels of the block located at the same position in the previous frame 
as the subject block. 

The block delay circuit 77 repeatedly outputs eight pixels in the adjacent left block which are the eight pixels 
closest to the subject block shown in Figure 17 as 1 to 8 to replace the (8x8) pixels of the subject block with 
the created block shown in Figure 17 as the block A. 

The switch 74 is switched according to the control signal output from the error judging circuit 84, and out- 
puts the concealed image signal to the raster scanning circuit 5. The raster scanning circuit 5 outputs the image 
signal in the order corresponding to the raster scanning to the D/A converter 3 via a terminal 7g. 

Further, it is possible to use the motion detecting circuit 23 shown in Figure 8 for the motion detecting circuit 
shown in Figure 13. 

According to the second embodiment described above, there are many effects listed below. 

Firstly, a motion detecting circuit is not necessary in the reproducing (receiving) apparatus. Therefore, the 
reproducing (receiving) apparatus, which is expected to be manufactured much more than the recording (trans- 
mitting) apparatus, becomes smaller. Accordingly a diffusion of the system which transmits and receives the 
image data is promoted. 

Secondly, the adaptive interpolation can depend on the motion detecting result of the subject block, not 
of the adjacent block. Therefore, the adaptive interpolation becomes more faithful to the original image. 
As described above, the present invention has many effects to improve the concealed image. 



Claims 



An image signal reproducing device, comprising 

(a) receiving means for receiving a transmitted signal from a transmitting path, the transmitted signal 
including encoded image data and subordinate data which indicates an encoding characteristic of the 
encoded image data; 

(b) decoding means for decoding the encoded image data received by said receiving means; and 

(c) error concealing means for concealing errors in the transmitted signal, said error concealing means 
deciding an error concealing characteristic to be carried out thereby in accordance with the subordinate 
data received by said receiving means. 

A device according to claim 1 , wherein said decoding means decides a decoding characteristic to be car- 
ried out thereby in accordance with the subordinate data received by said receiving means. 

A device according to claim 2, wherein the subordinate data is formed on the basis of AC component in- 
formation indicating energies of alternating components of image data. 

A device according to claim 3, wherein the encoded image data are orthogonally transformed from an 
amplitude domain to a frequency domain, and the subordinate data is formed on the basis of orthogonally 
transformed coefficients included in the image data. 

A device according to any of claims 1 to 4, wherein said error concealing means includes a motion de- 
tecting circuit which detects a motion of the image by using the subordinate data, and decides the error 
concealing characteristic on the basis of an output of the motion detecting circuit 
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10. 
11 



the encoded image data according to the subordinate data, 
in accordance with the subordinate data. 

™nent information indicating energies of alternating components of the .mage data. 
A device according to Cairn 9. wherein the image data are encoded by attack composed of a plurality 
£££ a^the AC component information is prepared for each of the blocks. 
A device according to daim 1 0. wherein sari error concealing means decides the error concealing char- 
acteristic for each block. 

thogonally transformed coefficients included in each block. 

,3 A deviceaccording to da.m12.where.n^^ 

orthogonally transformed coefficients exceed a predetermined value or not 

of a direct component of the image data. 

<*«»•-*• tain, d.t.c»d accortln, to h. dwa rionMM. 

Ad^.cc-d.n.to.u.n.ir.^n,.*^^ 

WwpoWlon using Irnsg. data in . fnm» „ ^ ,£Zi„ „la»m»Hin, mean, «ecute. 

subject frame and the other frame. 

r . . t nA l..«<AH in oorh hlnck. 
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17. 



18, 



of orthogonally transformed coeffidents induded in each block. 
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21. Adevice according to claim 20. wherein the AC component information is formed on the basis of whether 
the orthogonally transformed coefficients exceed a predetermined value or not 

22. Adevice according to claim 21 , wherein the AC component information is formed according to a number 
of orthogonally transformed coefficients exceeding the predetermined value. 

23. A device according to any of claims 19 to 22, wherein said motion detecting means detects a motion in- 
volved in the image signal in accordance with the AC component information and direct information in- 
dicating an energy of a direct component of the image data. 

24. A device according to claim 23, wherein said motion detecting means provides two motion detecting re- 
sults, one of the results being detected according to the AC component information, the other of the results 
being detected according to the direct information. 

25. A device according to claim 24. wherein said motion detecting means finally judges that the image signal 
involves a motion unless both of the results indicate little motion of the image 

26. An image signal reproducing device, comprising 

(a) receiving means for receiving a transmitted signal from a transmitting path, the transmitted signal in- 
cluding .mage data and motion data which indicates whether or not the image data involve a motion; and 

(b) error concealing means for concealing code errors in the transmitted signal, said error concealing 
means deciding an error concealing characteristic to be carried out thereby in accordance with the mo- 
tion data received by said receiving means. 

27. A device according to claim 26. wherein the image data are encoded to compress and an encoding char- 
actenstic of the image data is decided on the basis of the motion data, the device further comprising de- 
coding means for decoding the encoded image data in accordance with the motion data received by said 
receiving means. 1 

28. Adevice according to claim 27. wherein the motion data are produced by comparing image data between 
two adjacent fields and indicate whether the image data are encoded in each field or each frame and 
said decoding means decodes the image data in each field or each frame in accordance with the subor- 

ornate data. 

29. A device according to claim 28. wherein said error concealing means selectively executes an inter-frame 
interpolation using image data in a frame other than a subject frame to be concealed and an intra-frame 
interpolation using image data only in the subject frame in accordance with the motion data. 

A device according to claim 26 or 27. wherein the motion data are produced by comparing image data 
between two fields in a subject frame. 

A device according to claim 30. wherein said error concealing means selectively executes an inter-frame 
interpolation using image data in a frame other than the subject frame and an intra-frame interpolation 
using image data only in the subject frame in accordance with the motion data. 

32. An image signal reproducing device, comprising 

(a) receiving means for receiving a transmitted signal from a transmitting path, the transmitted signal 
including encoded image data and subordinate data; 

(b) decoding means for decoding the encoded image data, a characteristic of decoding in said decoding 
means is decided on the basis of the subordinate data; and aecooing 

(c) error concealing means for concealing code errors in the transmitted signal, said error concealing 
means deciding an error concealing characteristic to be carried out thereby on the basis of the subor- 
ainate data. 

33. An image signal processing method, comprising steps of 

detecting a motion involved in an image signal to be transmitted to produce motion information- 
transmitting the image signal and the motion information to a transmitting path- 
receiving the image signal and the motion information from the transmitting path- and 

acte H^ n ^Il n 2 6 k"^ °f^ rred the tran8mrtt8d ,ma S e 8 '9nal according to an operating char- 
acteristic decided on the basis of the transmitted motion information. 
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